^ TRANSCODER SYSTEM FOR ADAPTIVELY REDUCING 

^ FRAME-RATE 

RACKGROUND OF THE INVENTION 

1 . Field of the Invention 

5 The present invention relates to the technical field of video 

transcoding and, more particularly, to a transcoder system for adaptively 
reducing frame rate. 

2. Description of Related Art 

For typically transmitting an audio-visual stream, due to the 
10 limitation of network bandwidth, the stream needs video transcoding to 
convert it into an audio-visual stream with reduced frame-rate for 
transmission in a congested network. Namely, in video transcoding, 
frame-rate for moving picture compression data is reduced to form another 
moving picture compression data that reduces frame-rate and further 
1 5 bit-rate for meeting insufficient video fransmission requirement. 

FIG 1 is a block diagram of a typical video franscoder. As shown, a 
decoder 110 decodes a moving picture compression data and eliminates 
unwanted pictures. Next, an encoder 120 re-compresses and re-codes the 
remaining pictures in order to obtain reduced frame-rate. However, such a 
20 processing consumes much time because a motion vector estimation step is 

a must for coding. 

To overcome this, a solution proposed that motion vectors for 
macroblocks originally inputted are applied repeatedly to video transcoding. 
FIG. 2 is a block diagram of a typical video transcoder apphed for the 



aforementioned solution. As shown in FIG. 2, a variable length decoder is 
applied to compute the motion vectors of the macroblocks and next store 
the motion vectors in a memory used by a motion vector compensator m 
coding. However, only I- and P-pictures are transcoded for reduced 

5 frame-rate in the prior art, which skips B-pictures and thus cannot perform 
video transcoding completely and quickly for reduced frame-rate. 

Therefore, it is desirable to provide an improved franscoder system 
to mitigate and/or obviate the aforementioned problems. 
SUMMARY OF THE INVENTION 

10 The object of the present invention is to provide a franscoder system 

for adaptively reducing frame rate, which can avoid the aforementioned 
problems and perform video franscoding for pictures completely and 
quickly, thereby reducing required franscoding computation and increasing 
transcoding speed. 

15 In accordance with one aspect of the present invention, there is 

provided a transcoder system for adaptively reducing frame rate, The 
franscoder system can change audio-visual sfream of a GOP (group of 
pictures), each picture consisting of a plurality of macroblocks. The 
franscoder system includes a switching device, a variable length decoder 

20 (VLD), a motion vector compensation device, a memory and an 
encoder/decoder (codec). The switching device inputs the audio-visual 
sfream and permits passing a part of pictures in accordance with a first 
algorithm. The variable length decoder connected to the switching device 
retrieves motion vector for each macroblock in the pictures. The motion 
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vector compensation device computes output motion vectors respectively 
for the macroblocks in accordance with an input picture type. The memory 
connected to the motion vector compensation device stores the output 
motion vectors computed by the motion vector compensation device. The 
codec connected to the switching device decodes the pictures passing 
through the switching device using motion vector technique and then 
re-codes the pictures decoded in accordance with the output motion vectors 
computed by the motion vector compensation device. 

Other objects, advantages, and novel features of the invention will 
become more apparent from the following detailed description when taken 
in conjunction with the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 

FIG 1 is a block diagram of a typical video transcoder; 
FIG 2 is a block diagram of another typical video transcoder; 
FIG 3 is a block diagram of a transcoder system for adaptively 
reducing frame rate in accordance with the invention; 

FIG 4 is a schematic flow of operating a switching device of FIG 3 
in accordance with the invention; 

FIG 5 is a schematic table of types of input pictures to be coded in 
accordance with the invention; 

FIG 6 is a schematic illusfration of a first type of pictures in an 
MPEG 4 compression data in accordance with the invention; 

FIG 7 is a schematic illustration of second, third and fourth types of 
pictures in an MPEG 4 compression data; 
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FIG. 8 a schematic illustration of selecting and computing motion 
vectors for macroblocks of a first type frames using a bi-directional 
dominant vector selection in accordance with the invention; 

FIG. 9 is a schematic illustration of selecting and computing motion 
5 vectors for macroblocks of a second type frames using a bi-directional 
dominant vector selection in accordance with the invention; and 

FIG. 10 is a schematic illustration of selecting and computing 
motion vectors for macroblocks of a third type frames using a bi-directional 
dominant vector selection in accordance with the invention. 
10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

FIG. 3 shows a block diagram of an inventive transcoder system for 
adaptively reducing frame rate. As shown, the transcoder system includes a 
first inverse quantizer 305, a switching device 310, a variable length 
decoder 3 1 5, a discrete cosine transform (DCT) device 320, a motion vector 
1 5 compensation device 325, a memory 330, a quantizer 335, a second inverse 
quantizer 340, an inverse DCT device 345 and a variable length encoder 
350. The transcoder system, compared to the prior sequential video 
transcoding structure (FIG 1), is simpler because an inverse DCT is 
eliminated. 

20 After receiving transmitted moving picture compression data, the 

inventive transcoder system performs bit-based decoding for converting a 
one-dimension data into a 2D data in a matrix. Next, the first inverse 
quantizer 305 performs inverse quantization and also the transmitted 
moving picture compression data is decoded by the variable length decoder 

4 



•I 1 

315 for motion vectors of macroblocks. The decoded motion vectors are 
stored in the memory 330 for computing motion vectors of macroblocks in 
coding. 

The switching device 310 is a reduced frame-rate switch to switch 

5 on or off" in accordance with network throughput (a predetermined 
algorithm). The device 310 can pick one every N pictures for passing, so as 
to reduce frame-rate. As shown in FIG. 4, when an input picture is to be 
skipped and not coded, the device 310 switches off to reject the picture to 
the first inverse quantizer 305. On the other hand, when an input picture is 

10 to be coded, the device 310 switches on to enter the picture into the 
quantizer 305 for coding. 

MPEG coding predicts error of motion vector utilizing block-based 
motion compensation, prediction using the content difference between a 
forward or backward frame (picture) to the current frame. For I frames 

15 (Intra-coded pictures), the signals are processed directly by discrete cosine 
transform (DCT). For P or B frames, the signals are processed by the 
motion vector compensation device 325 for computing motion vectors and 
then motion compensations. 

Next, the DGT device 320 performs a discrete cosine transform for 

20 converting spatial signals into frequency signals to thus elirhinate spatial 
correlation. The quantization device 335 performs a quantization procedure 
on frequency signals in accordance with a quantization matrix 
corresponding to frame coding. In addition, unimportant information is 
eliminated to reduce digitized moving region. Since a 2D of data in a 
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matrix is created after quantization, the 2D of data is changed into an array 
(ID) of data for performing a variable length coding by the variable length 
encoder 350 and then combining with the motion vectors to produce video 
compression code. 

5 The motion vector compensation device 325 uses a bi-directional 

dominant vector selection to compute macroblock and block motion vectors 
for coding and outputting moving picture compression data. 

The bi-directional dominant vector selection divides input frames 
into four types in accordance with a current and a preceding input frames to 

10 be coded. As shown in FIG. 5, when the preceding input frame to be coded 
is an I- or P-picture and the current input frame to be coded is a P-picture, 
the current input frame to be coded is of a first type. When the preceding 
input fraiiie to be coded is an I- or P-picture and the current input frame to 
be coded is a B-picture, the current input frame to be coded is of a second 

15 type. 

When the preceding input frame to be coded is a B-picture and the 
current input frame to be coded is a B-picture, the current input frame to be 
coded is of a third type. When the preceding input frame to be coded is a 
B-picture and the current input frame to be coded is a P-picture, the current 
20 input frame to be coded is of a fourth type. 

FIG 6 is a schematic illustration of the first type of frames in an 
MPEG 4 compression data. Namely, input moving picture compression 
data meets with the MPEG-4 Advance Simple Profile Standard, where M=3, 
intra period=15. As shown, for every 6 input frames, an input frame is 
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retained as a coded output frame and the following 5 input frames are 
discarded. For example, a coded output frame(2-out), which is of the first 
type in accordance with FIG. 5, corresponds to a current P-picture input 
frame(7-in), which follows a preceding I-picture input frame(l-in) to be 
5 coded. 

FIG 7 is a schematic illustration of second, third and fourth types of 
frames in an MPEG 4 compression data. Namely, input moving picture 
compression data meets with the MPEG-4 Advance Simple Profile 
Standard, where M=3, infra period=15. As shown in FIG. 7, for every 4 

1 0 frames, an input frame is retained as a coded output frame and the following 
3 input frames are discarded. For example, a coded output frame(2-out), 
which is of the second type in accordance with FIG. 5, corresponds to a 
current B-picture input frame(5-in), which follows a preceding I-picture 
input frame(l-in) to be coded. Another coded output frame(3-out), which is 

15 of the third type, corresponds to a current B-picture input frame(9-in), 
which follows a preceding B-picture input frame(5-in) to be coded. 
Another coded output frame(4-out), which is of the fourth type, corresponds 
to a current P-picture input frame(13-in), which follows a preceding 
B-picture input frame(9-in) to be coded. 

20 FIG 8 a schematic illusfration of selecting and computing motion 

vectors for macroblocks of a first type of frames in accordance with the 
invention, which is processed by the motion vector compensation device 
325 using a bi-directional dominant vector selection. As shown in FIG. 6, 
only I- and P-pictures are used and all B-pictures are skipped. When the 
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input frame(7-in) is transcoded into the output frame(2-out), in accordance 
with FIG 7, macroblock motion vector indicated by MB(1,0)7 in 
frame(2-out) is computed by finding motion vector MVt(f,7-4) for MB( 1,0)7 
firsdy. The motion vector MVt(f, 7. 4) is a motion vector for a reference block 
5 which points to input jframe(4-in) as looking back with MB( 1,0)7 - The 
reference block overlaps in four macroblocks in frame(4-in) and mostly on 
MB(0', 0')4. As such, MB(0', 0')4 is selected as a dominant macroblock. 
MB(0', 0')4 is of P-picture and accordingly it also has a motion vector 
MVt(f,4.i) pointing to frame(l-in). Thus, the dominant vector MVt(f,7-4) can 
10 be obtained by equation (1 ): 

where the dominant vector MVT(f,7-i) is a motion vectors having the same 
position in output frame(2-out) and input frame(7-in) as MB(1, 0)7. 

FIG. 9 a schematic illustration of selecting and computing motion 

1 5 vectors for macroblocks of a second type of frames in accordance with the 
invention, which is processed by the motion vector compensation device 
325 using a bi-directional dominant vector selection. As shown in FIG. 7, 
when the B-picture input frame(5-in) is transcoded into the output 
frame(2-out), in accordance with FIG. 9, macroblock MB( 1,0)5 has two 

20 motion vectors, one as a forward motion vector MVt(f,5-4) and the other as a 
backward motion vector MVt(b,5.7)5 where appropriate one of the two motion 
vectors is selected to compute dominant vector. First, the vector MVt(f,5-4) 
points to a reference block in input frame frame(4-in). The reference block 



overlaps in four macroblocks in fi-ame(4-in) and mostly on MB(0', 0')4 in 
an overlapped proportion of R(5-4) with a area size represented by equation 

(2): 

^<s-.>=^ " (2) 
wxw 

5 Alternatively, the vector MVt(b,5-7) points to a reference block in 

input frame(7"in). The reference block overlaps in four macroblocks in 
frame(7-in) and mostly on MB(r', 0")7 in an overlapped proportion of 

R.5.7.( = ^^^). Since frame(7-in) is a P-picture, if MB(1", O")? has a 

wxw 

motion vector MVt(7_4), a reference block in frame(4-in) pointed by this 
10 vector has the most overlapped area on MB(l\V)4 in an overlapped 

proportion of R(7^)(= ). Therefore, the most overlapped area, which 

wxw 

corresponds to a dominant macroblock as a dominant macroblock, is 
determined by equation (3): 

max(i?^5_4) , i?(5_7) X ) . (3) 

15 In accordance with equation (3), the dominmt macroblock is 

MB(0',0')4 when R(5.4) is greater than R(5.7)*R(7^). If MB(0',0')4 has a 
motion vector MVt(f,4.i), a dominant vector MVT(f,5.i) is obtained by equation 
(4-1): 

^^T{f,5-\) ~ ^^tif ,5-4) + MF,(/.4-o' (4-1) 

20 where MVT(f,5-i) is a motion vectors having the same position in ou^ut 
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frame frame(2-out) and input frame(5-in) as MB(0, 0)5. 

Conversely, the dominant macroblock is MB(V\ O")? when 
R(5.7)*R(7^)is greater than R^s^y If MB(r', 0")? has motion vector MVt(f,7.4), 
the vector MVt(f,7.4) points to a reference block overlapped on MB(r,r)4 in 
5 frame(4-in). If MB(r,r)4 has motion vector MVti(f,4.i), in this case the 
dominant vector MVT(f,5-i) is obtained by equation (4-2): 

^r(/.5-i) = ^.(..5-7) + ^/(/,7-4) + ^n(/.4-i) , (4-2) 

where MVT(f,5-i) is a motion vectors having the same position in output 
frame(2-out) and input frame(5-in) as MB(0, 0)5. 

10 FIG. 10 a schematic illustration of selecting and computing motion 

vectors for macroblocks of a third type of frames in accordance with the 
invention, which is processed by the motion vector compensation device 
325 using a bi-directional dominant vector selection. As shown in FIG. 7, 
when the B-picture input frame(9-in) is transcoded into the output 

15 frame(3-out), in accordance with FIG. 10, macroblock MB(0,0)9 has two 
motion vectors, one as a forward motion vector MVt(f,9-7) and the other as a 
backward vector MVt(b,9-io)- bi accordance with the aforementioned 
bi-directional dominant vector selection and computation of motion vectors 
for macroblocks of the second type of frames, an appropriate motion vector 

20 MVt(f,9-7) is selected to compute a dominant vector. Since motion vector of 
output frame(3-out) points to output frame(2-out) obtained by coding input 
frame(5-in), macroblock motion vector of frame(7-in) pointing to 
frame(4-in) is computed firstly. The same position in frame(5-in) as 
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macroblock MB(0\r)7 in frame(7) is located on macroblock MB(0'",1'")5. 
MB(0"',r")5 has a forward motion vector MVt(f,5-4) which points to 
frame(4-in). Motion vector MVT(f,7.5) for a reference block in frame(5-in) 
pointed by MB(0%r)7 is obtained by equation (5): 

Next, in accordance with vector MVt(f,9.7) obtained by applying the 
aforementioned bi-directional dominant vector selection to the second type 
of frames and vector MVT(f,7-5) obtained by equation (5), predictive motion 
vector MVT(f,9-5) for outputting is obtained by equation (6): 

1 0 M^^r(/.9-5) = ^.(/,9-7) + ^.(/.7-5) ■ (6) 

Finally, the inventive motion vector compensation device 325 
selects and computes macroblock motion vectors of a fourth type of frames 
using a bi-directional dominant vector selection. As shown in FIG. 6, when 
the input frame(13-in) is transcoded into the output frame(4-out), motion 

15 vector to be computed is pointed to the output frame(3-out). A P-picture 
frame(lO-in) between frame(13-in) and frame(9-in) is skipped. Since 
frame(13-in) is a P-picture, macroblock motion vector MVt(f,i3.io) of 
frame(13-in) pointing to frame(lO-in) is obtained firstly. Next, motion 
vector MVT(f,io-9) for macroblock, pointing to frame(9-in), with the most 

20 area in frame(lO-in) overlapped by a reference block pointed by MVt(f,i3.io), 
is computed. Finally, predictive motion vector MVT(f,i3-9) for outputting is 
obtained by equation (7): 
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^n/.13-9) = ^(/,13-10) + ^/(/.10-9) • O) 

In view of foregoing, it is known that the invention can process 
video transcoding quickly for reduced frame-rate by a simple transcoder 
system with reduced frame-rate. Also, in accordance with P- and 
5 B-pictures, the invention divides input frames into four types and computes 
macroblock and block motion vectors respectively for each type. Therefore, 
the aforementioned problem in the prior art is eliminated and video 
transcoding for image can be processed completely and quickly, thereby 
eliminating transcoding computation and fiirther increasing transcoding 
10 speed. 

Although the present invention has been explained in relation to its 
preferred embodiment, it is to be understood that many other possible 
modifications and variations can be made without departing from the spirit 
and scope of the invention as hereinafter claimed. 
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